2026-09-30 16:38:20,898 [ 280439 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 16:38:20,898 [ 280439 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 16:38:20,898 [ 280439 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 16:38:20,898 [ 280439 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_h9p2xq --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_max_authentication_methods_per_user/test.py::test_alter test_merge_tree_s3/test.py::test_alter_table_columns[node] test_partition/test.py::test_attach_check_all_parts test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] test_placement_info/test.py::test_placement_info_from_config test_jdbc_bridge/test.py::test_jdbc_delete test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] [gw4] [ 1%] PASSED test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting [gw4] [ 2%] PASSED test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create [gw8] [ 3%] PASSED test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file [gw4] [ 4%] PASSED test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting [gw3] [ 5%] PASSED test_partition/test.py::test_attach_check_all_parts [gw4] [ 6%] PASSED test_max_authentication_methods_per_user/test.py::test_create_default_setting test_partition/test.py::test_cannot_attach_active_part [gw3] [ 7%] PASSED test_partition/test.py::test_cannot_attach_active_part [gw8] [ 8%] PASSED test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_partition/test.py::test_detached_part_dir_exists [gw8] [ 9%] PASSED test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client [gw3] [ 10%] PASSED test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts [gw8] [ 11%] PASSED test_placement_info/test.py::test_placement_info_missing_data [gw3] [ 12%] PASSED test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached [gw5] [ 13%] PASSED test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node [gw5] [ 14%] PASSED test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert [gw5] [ 15%] PASSED test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query [gw5] [ 16%] PASSED test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine [gw5] [ 17%] PASSED test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update [gw5] [ 18%] PASSED test_jdbc_bridge/test.py::test_jdbc_update [gw3] [ 19%] PASSED test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex [gw3] [ 20%] PASSED test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple [gw3] [ 21%] PASSED test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_jbod_ha/test.py::test_jbod_ha [gw3] [ 22%] PASSED test_partition/test.py::test_system_detached_parts [gw1] [ 23%] PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_keeper_availability_zone/test.py::test_get_availability_zone [gw7] [ 24%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where [gw7] [ 25%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where [gw7] [ 26%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree [gw2] [ 27%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] [gw7] [ 28%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree [gw2] [ 29%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] [gw1] [ 30%] PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 [gw1] [ 31%] PASSED test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value [gw4] [ 32%] PASSED test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart [gw4] [ 33%] PASSED test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client [gw4] [ 34%] PASSED test_postgresql_protocol/test.py::test_python_client [gw8] [ 35%] PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed [gw9] [ 36%] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted [gw8] [ 37%] PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed [gw2] [ 38%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] test_interserver_dns_retires/test.py::test_query [gw2] [ 39%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] [gw2] [ 40%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] [gw9] [ 41%] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error [gw9] [ 42%] SKIPPED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error [gw1] [ 43%] PASSED test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions [gw3] [ 44%] PASSED test_keeper_availability_zone/test.py::test_get_availability_zone [gw2] [ 45%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_keeper_memory_soft_limit/test.py::test_soft_limit_create [gw2] [ 46%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] [gw2] [ 47%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] [gw1] [ 48%] PASSED test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions [gw5] [ 49%] PASSED test_jbod_ha/test.py::test_jbod_ha test_postgresql_replica_database_engine_1/test.py::test_different_data_types [gw7] [ 50%] PASSED test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_and_access_storage/test.py::test_create_replicated [gw1] [ 51%] PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw8] [ 52%] PASSED test_interserver_dns_retires/test.py::test_query test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading [gw4] [ 53%] SKIPPED test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update [gw3] [ 54%] PASSED test_keeper_memory_soft_limit/test.py::test_soft_limit_create [gw1] [ 55%] PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables [gw1] [ 56%] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_keeper_profiler/test.py::test_profiler [gw1] [ 57%] PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries [gw5] [ 58%] PASSED test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_persistent_log_multinode/test.py::test_restart_multinode [gw1] [ 59%] PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases [gw4] [ 60%] PASSED test_log_levels_update/test.py::test_log_levels_update [gw1] [ 61%] PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 [gw1] [ 62%] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 [gw7] [ 63%] PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_postgresql_replica_database_engine_1/test.py::test_quoting_2 [gw1] [ 64%] PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index [gw1] [ 65%] PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml [gw1] [ 66%] PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_keeper_secure_client/test.py::test_connection test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished [gw6] [ 67%] ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] [gw6] [ 68%] ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] [gw6] [ 69%] ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] [gw6] [ 70%] ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] [gw1] [ 71%] PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction [gw5] [ 72%] PASSED test_keeper_persistent_log_multinode/test.py::test_restart_multinode [gw8] [ 73%] PASSED test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading [gw1] [ 74%] PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction [gw7] [ 75%] PASSED test_keeper_secure_client/test.py::test_connection [gw0] [ 76%] ERROR test_merge_tree_s3/test.py::test_alter_table_columns[node] test_merge_tree_s3/test.py::test_attach_detach_partition[node] [gw0] [ 77%] ERROR test_merge_tree_s3/test.py::test_attach_detach_partition[node] test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] [gw0] [ 78%] ERROR test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] [gw0] [ 79%] ERROR test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] test_merge_tree_s3/test.py::test_freeze_unfreeze[node] [gw0] [ 80%] ERROR test_merge_tree_s3/test.py::test_freeze_unfreeze[node] test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] [gw0] [ 81%] ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] [gw0] [ 82%] ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] [gw0] [ 83%] ERROR test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] [gw0] [ 84%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] [gw0] [ 85%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] [gw0] [ 86%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] [gw0] [ 87%] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] [gw0] [ 88%] ERROR test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] [gw0] [ 89%] ERROR test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] [gw0] [ 90%] ERROR test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] [gw0] [ 91%] ERROR test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] [gw0] [ 92%] ERROR test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] [gw0] [ 93%] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] [gw0] [ 94%] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] [gw0] [ 95%] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] [gw0] [ 96%] ERROR test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] [gw0] [ 97%] ERROR test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] [gw0] [ 98%] ERROR test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] test_merge_tree_s3/test.py::test_table_manipulations[node] [gw0] [ 99%] ERROR test_merge_tree_s3/test.py::test_table_manipulations[node] [gw3] [100%] ERROR test_keeper_profiler/test.py::test_profiler ==================================== ERRORS ==================================== ___________ ERROR at setup of test_read_after_cache_is_wiped[0-4-2] ____________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:38:26 [ 542 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:38:26 [ 542 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:38:26 [ 542 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV HOSTNAME 00b8eb8f3e61 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID acd1bdc12ef649aa85152ba922c22ba8 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PYTEST_XDIST_WORKER gw6 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : ENV PYTEST_CURRENT_TEST test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] (setup) (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:38:26 [ 542 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:26 [ 542 ] DEBUG : Cluster name: project_name:roottestmergetrees3withcache_gw6. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:26 [ 542 ] INFO : Starting cluster... (test.py:21, cluster) 2026-09-30 16:38:26 [ 542 ] INFO : Running tests in /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/test.py (cluster.py:2790, start) 2026-09-30 16:38:26 [ 542 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:38:26 [ 542 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:26 [ 542 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:26 [ 542 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:26 [ 542 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:38:26 [ 542 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:26 [ 542 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:26 [ 542 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:26 [ 542 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3withcache_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:38:26 [ 542 ] DEBUG : No running containers for project: roottestmergetrees3withcache_gw6 (cluster.py:904, cleanup) 2026-09-30 16:38:26 [ 542 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:38:26 [ 542 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:38:26 [ 542 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:26 [ 542 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:38:26 [ 542 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/configs/config.d/ssl_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/configs/config.d/query_log.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/database (cluster.py:4653, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:38:26 [ 542 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env (cluster.py:86, _create_env_file) 2026-09-30 16:38:26 [ 542 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:26 [ 542 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:26 [ 542 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:26 [ 542 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:26 [ 542 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:38:26 [ 542 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:39:29 [ 542 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:39:29 [ 542 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling resolver ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:39:31 [ 542 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:34 [ 542 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:40:34 [ 542 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:40:36 [ 542 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:32 [ 542 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:41:32 [ 542 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:41:35 [ 542 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:42:27 [ 542 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:42:27 [ 542 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:42:32 [ 542 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:43:20 [ 542 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:43:20 [ 542 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:43:20 [ 542 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:43:20 [ 542 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:20 [ 542 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:20 [ 542 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:20 [ 542 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3withcache_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : No running containers for project: roottestmergetrees3withcache_gw6 (cluster.py:904, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stdout:2 (cluster.py:121, run_and_check) 2026-09-30 16:43:20 [ 542 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:43:20 [ 542 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Docker networks for project roottestmergetrees3withcache_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:20 [ 542 ] DEBUG : Docker containers for project roottestmergetrees3withcache_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:20 [ 542 ] DEBUG : Docker volumes for project roottestmergetrees3withcache_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:20 [ 542 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3withcache_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : No running containers for project: roottestmergetrees3withcache_gw6 (cluster.py:904, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:20 [ 542 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:20 [ 542 ] DEBUG : Stdout:2 (cluster.py:121, run_and_check) __________ ERROR at setup of test_read_after_cache_is_wiped[8192-2-1] __________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________ ERROR at setup of test_write_is_cached[0-2] __________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_write_is_cached[8192-1] ________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/ssl_conf.xml", "configs/config.d/query_log.xml", ], user_configs=["configs/config.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3_with_cache/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_alter_table_columns[node] _______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:38:26 [ 509 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:38:26 [ 509 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:38:26 [ 509 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV HOSTNAME 00b8eb8f3e61 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV WORKER_FREE_PORTS 30000 30001 30002 30003 30004 30005 30006 30007 30008 30009 30010 30011 30012 30013 30014 30015 30016 30017 30018 30019 30020 30021 30022 30023 30024 30025 30026 30027 30028 30029 30030 30031 30032 30033 30034 30035 30036 30037 30038 30039 30040 30041 30042 30043 30044 30045 30046 30047 30048 30049 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID acd1bdc12ef649aa85152ba922c22ba8 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PYTEST_XDIST_WORKER gw0 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : ENV PYTEST_CURRENT_TEST test_merge_tree_s3/test.py::test_alter_table_columns[node] (setup) (cluster.py:446, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:38:26 [ 509 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:26 [ 509 ] DEBUG : Cluster name: project_name:roottestmergetrees3_gw0. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:26 [ 509 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:26 [ 509 ] DEBUG : Cluster name: project_name:roottestmergetrees3_gw0. Added instance name:node_with_limited_disk tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:26 [ 509 ] INFO : Starting cluster... (test.py:49, cluster) 2026-09-30 16:38:26 [ 509 ] INFO : Running tests in /ClickHouse/tests/integration/test_merge_tree_s3/test.py (cluster.py:2790, start) 2026-09-30 16:38:26 [ 509 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:38:26 [ 509 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:26 [ 509 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:26 [ 509 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:26 [ 509 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:38:26 [ 509 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:26 [ 509 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:26 [ 509 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:26 [ 509 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:38:26 [ 509 ] DEBUG : No running containers for project: roottestmergetrees3_gw0 (cluster.py:904, cleanup) 2026-09-30 16:38:26 [ 509 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:38:26 [ 509 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:38:26 [ 509 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:26 [ 509 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:38:26 [ 509 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/bg_processing_pool_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/blob_log.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/database (cluster.py:4653, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Setup directory for instance: node_with_limited_disk (cluster.py:2810, start) 2026-09-30 16:38:26 [ 509 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/bg_processing_pool_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/blob_log.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/database (cluster.py:4653, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:38:26 [ 509 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env (cluster.py:86, _create_env_file) 2026-09-30 16:38:26 [ 509 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:26 [ 509 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:26 [ 509 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:26 [ 509 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:26 [ 509 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:38:26 [ 509 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:02 [ 509 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:40:02 [ 509 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling node_with_limited_disk ... Pulling resolver ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling proxy1 ... done Pulling node ... done Pulling proxy2 ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:40:05 [ 509 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:43 [ 509 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:41:43 [ 509 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node_with_limited_disk ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:41:46 [ 509 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:20 [ 509 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:43:20 [ 509 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling minio1 ... error Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:43:24 [ 509 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:46 [ 509 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:44:46 [ 509 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling resolver ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling node ... done Pulling minio1 ... error Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:44:50 [ 509 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:46:23 [ 509 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_limited_disk ... Pulling node ... Pulling node_with_limited_disk ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... Pulling node_with_limited_disk ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node_with_limited_disk ... done Pulling node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:46:23 [ 509 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:46:23 [ 509 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:46:23 [ 509 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:23 [ 509 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:23 [ 509 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:23 [ 509 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:23 [ 509 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:23 [ 509 ] DEBUG : No running containers for project: roottestmergetrees3_gw0 (cluster.py:904, cleanup) 2026-09-30 16:46:23 [ 509 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:23 [ 509 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:23 [ 509 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:23 [ 509 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:23 [ 509 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:46:23 [ 509 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:24 [ 509 ] DEBUG : Docker networks for project roottestmergetrees3_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:24 [ 509 ] DEBUG : Docker containers for project roottestmergetrees3_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:24 [ 509 ] DEBUG : Docker volumes for project roottestmergetrees3_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:24 [ 509 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:24 [ 509 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:24 [ 509 ] DEBUG : No running containers for project: roottestmergetrees3_gw0 (cluster.py:904, cleanup) 2026-09-30 16:46:24 [ 509 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:24 [ 509 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:24 [ 509 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:24 [ 509 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _____________ ERROR at setup of test_attach_detach_partition[node] _____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __ ERROR at setup of test_cache_with_full_disk_space[node_with_limited_disk] ___ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_freeze_system_unfreeze[node] ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________ ERROR at setup of test_freeze_unfreeze[node] _________________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_insert_same_partition_and_merge[False-node] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_insert_same_partition_and_merge[True-node] _______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_lazy_seek_optimization_for_async_read[node] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_merge_canceled_by_drop[node] ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_merge_canceled_by_s3_errors[node-broken_s3] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_merge_canceled_by_s3_errors_when_move[node] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_move_partition_to_another_disk[node] __________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_move_replace_partition_to_another_table[node] _____ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_disk_apply_new_settings[node] ____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_s3_disk_heavy_write_check_mem[node] __________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_s3_disk_reads_on_unstable_connection[node] _______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_no_delete_objects[node] _______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____________ ERROR at setup of test_simple_insert_select[0-16-node] ____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_simple_insert_select[8192-12-node] ___________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_table_manipulations[node] _______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/config.xml", "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], user_configs=[ "configs/config.d/users.xml", ], stay_alive=True, with_minio=True, ) cluster.add_instance( "node_with_limited_disk", main_configs=[ "configs/config.d/storage_conf.xml", "configs/config.d/bg_processing_pool_conf.xml", "configs/config.d/blob_log.xml", ], with_minio=True, tmpfs=[ "/jbod1:size=2M", ], ) logging.info("Starting cluster...") > cluster.start() test_merge_tree_s3/test.py:50: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_limited_disk ... E Pulling node ... E Pulling node_with_limited_disk ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling node_with_limited_disk ... digest: sha256:2ea9da862c215fd684... E Pulling node_with_limited_disk ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node_with_limited_disk ... done E Pulling node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________________ ERROR at setup of test_profiler ________________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def started_cluster(): try: > cluster.start() test_keeper_profiler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node2 ... E Pulling node3 ... E Pulling node1 ... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling minio1 ... error E Pulling node3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node3 ... digest: sha256:2ea9da862c215fd684... E Pulling node3 ... status: image is up to date for a... E Pulling node3 ... done E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node3 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:42:03 [ 518 ] INFO : Running tests in /ClickHouse/tests/integration/test_keeper_profiler/test.py (cluster.py:2790, start) 2026-09-30 16:42:03 [ 518 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:42:03 [ 518 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:42:03 [ 518 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:42:03 [ 518 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:42:03 [ 518 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:42:03 [ 518 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:42:04 [ 518 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:42:04 [ 518 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:42:04 [ 518 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperprofiler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:42:04 [ 518 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:42:04 [ 518 ] DEBUG : No running containers for project: roottestkeeperprofiler_gw3 (cluster.py:904, cleanup) 2026-09-30 16:42:04 [ 518 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:42:04 [ 518 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:42:04 [ 518 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:42:04 [ 518 ] DEBUG : Stdout:2 (cluster.py:121, run_and_check) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:42:04 [ 518 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_profiler/configs/keeper_config1.xml'] to /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup directory for instance: node2 (cluster.py:2810, start) 2026-09-30 16:42:04 [ 518 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_profiler/configs/keeper_config2.xml'] to /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/database (cluster.py:4653, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/logs (cluster.py:4664, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup directory for instance: node3 (cluster.py:2810, start) 2026-09-30 16:42:04 [ 518 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_profiler/configs/keeper_config3.xml'] to /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/database (cluster.py:4653, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/logs (cluster.py:4664, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:42:04 [ 518 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env (cluster.py:86, _create_env_file) 2026-09-30 16:42:04 [ 518 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:42:04 [ 518 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:42:04 [ 518 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:42:04 [ 518 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:42:04 [ 518 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:42:04 [ 518 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:42:32 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:42:32 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:43:02 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:43:03 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:30 [ 518 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:43:30 [ 518 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling node1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling resolver ... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:43:32 [ 518 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:33 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:43:33 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:44:03 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:44:05 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:44:35 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:44:40 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:07 [ 518 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:45:07 [ 518 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling node1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node3 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling node3 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:45:10 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:45:10 [ 518 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:45:18 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:45:48 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:46:10 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:46:40 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:55 [ 518 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:46:55 [ 518 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling node1 ... Pulling minio1 ... Pulling node2 ... Pulling node3 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:46:58 [ 518 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:18 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:47:48 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:48:53 [ 518 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:48:53 [ 518 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling node1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node3 ... pulling from altinityinfra/integr... Pulling node2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node3 ... done Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:48:57 [ 518 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:49:06 [ 518 ] INFO : Connecting to 172.16.15.3(172.16.15.3):2181, use_ssl: False (connection.py:650, _connect) 2026-09-30 16:49:36 [ 518 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:50:41 [ 518 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node3 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node3 ... digest: sha256:2ea9da862c215fd684... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:50:41 [ 518 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:50:41 [ 518 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:50:41 [ 518 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:50:41 [ 518 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:50:41 [ 518 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:50:41 [ 518 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperprofiler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : No running containers for project: roottestkeeperprofiler_gw3 (cluster.py:904, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:50:41 [ 518 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:50:41 [ 518 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Docker networks for project roottestkeeperprofiler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:50:41 [ 518 ] DEBUG : Docker containers for project roottestkeeperprofiler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:50:41 [ 518 ] DEBUG : Docker volumes for project roottestkeeperprofiler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:50:41 [ 518 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperprofiler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : No running containers for project: roottestkeeperprofiler_gw3 (cluster.py:904, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:50:41 [ 518 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:50:41 [ 518 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) =============================== warnings summary =============================== test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-39 (attack) Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/ClickHouse/tests/integration/test_postgresql_replica_database_engine_1/test.py", line 431, in attack cursor.execute(query_pool[query_id].format(random_table_name)) psycopg2.errors.NumericValueOutOfRange: integer out of range warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 517.60s setup test_keeper_profiler/test.py::test_profiler 477.74s setup test_merge_tree_s3/test.py::test_alter_table_columns[node] 294.24s setup test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 106.15s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 105.47s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 104.34s setup test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 101.60s setup test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading 67.12s call test_interserver_dns_retires/test.py::test_query 60.11s setup test_postgresql_protocol/test.py::test_java_client 59.40s setup test_jdbc_bridge/test.py::test_jdbc_delete 58.80s setup test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication 58.02s setup test_placement_info/test.py::test_placement_info_from_config 56.98s setup test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 56.75s setup test_partition/test.py::test_attach_check_all_parts 56.68s setup test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 55.96s setup test_max_authentication_methods_per_user/test.py::test_alter 55.92s setup test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node 54.07s setup test_keeper_memory_soft_limit/test.py::test_soft_limit_create 52.16s setup test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 51.50s setup test_jbod_ha/test.py::test_jbod_ha 50.90s setup test_keeper_secure_client/test.py::test_connection 50.63s setup test_keeper_persistent_log_multinode/test.py::test_restart_multinode 50.47s setup test_keeper_and_access_storage/test.py::test_create_replicated 49.99s setup test_log_levels_update/test.py::test_log_levels_update 43.73s setup test_keeper_availability_zone/test.py::test_get_availability_zone 39.33s call test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication 35.52s call test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions 33.70s call test_jbod_ha/test.py::test_jbod_ha 22.73s teardown test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 22.52s teardown test_postgresql_protocol/test.py::test_python_client 22.37s teardown test_jdbc_bridge/test.py::test_jdbc_update 22.33s call test_keeper_persistent_log_multinode/test.py::test_restart_multinode 21.61s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 20.82s call test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication 18.46s call test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 17.42s call test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart 16.42s call test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 16.27s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 16.04s call test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 15.58s call test_partition/test.py::test_system_detached_parts 15.47s call test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 15.37s teardown test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 15.22s call test_postgresql_replica_database_engine_1/test.py::test_single_transaction 14.80s call test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 13.28s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 11.83s call test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 11.48s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 11.08s teardown test_keeper_memory_soft_limit/test.py::test_soft_limit_create 10.42s call test_jdbc_bridge/test.py::test_jdbc_delete 9.39s teardown test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading 8.68s call test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading 7.93s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 7.89s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 7.29s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 7.27s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 7.14s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 7.07s call test_postgresql_replica_database_engine_1/test.py::test_different_data_types 6.83s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 6.81s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 6.37s teardown test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed 6.27s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 6.15s teardown test_partition/test.py::test_system_detached_parts 6.01s teardown test_keeper_secure_client/test.py::test_connection 5.86s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 5.43s call test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 5.42s call test_partition/test.py::test_make_clone_in_detached 4.86s teardown test_placement_info/test.py::test_placement_info_missing_data 4.84s teardown test_max_authentication_methods_per_user/test.py::test_create_default_setting 4.40s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 4.29s teardown test_keeper_availability_zone/test.py::test_get_availability_zone 4.18s teardown test_log_levels_update/test.py::test_log_levels_update 4.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 3.70s teardown test_jbod_ha/test.py::test_jbod_ha 3.60s call test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 3.53s call test_log_levels_update/test.py::test_log_levels_update 3.49s teardown test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions 3.46s call test_partition/test.py::test_detached_part_dir_exists 3.36s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 3.35s call test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 3.21s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 3.15s teardown test_postgresql_replica_database_engine_1/test.py::test_single_transaction 3.04s call test_partition/test.py::test_drop_detached_parts 2.93s call test_partition/test.py::test_attach_check_all_parts 2.90s call test_placement_info/test.py::test_placement_info_from_imds 2.84s call test_placement_info/test.py::test_placement_info_from_file 2.76s teardown test_keeper_persistent_log_multinode/test.py::test_restart_multinode 2.65s call test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 2.52s call test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value 2.49s call test_partition/test.py::test_partition_complex 2.42s teardown test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication 2.11s teardown test_keeper_and_access_storage/test.py::test_create_replicated 2.06s teardown test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 1.80s teardown test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 1.68s call test_postgresql_replica_database_engine_1/test.py::test_quoting_2 1.62s call test_postgresql_replica_database_engine_1/test.py::test_quoting_1 1.41s call test_max_authentication_methods_per_user/test.py::test_alter 1.39s teardown test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication 1.35s call test_max_authentication_methods_per_user/test.py::test_alter_default_setting 1.15s setup test_partition/test.py::test_drop_detached_parts 1.13s setup test_partition/test.py::test_system_detached_parts 1.02s teardown test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 1.01s teardown test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart 0.98s teardown test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.97s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.97s teardown test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.97s setup test_partition/test.py::test_partition_simple 0.96s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 0.95s teardown test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 0.94s teardown test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.92s teardown test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value 0.91s call test_postgresql_protocol/test.py::test_psql_client 0.89s teardown test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.87s setup test_partition/test.py::test_partition_complex 0.86s call test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node 0.85s call test_jdbc_bridge/test.py::test_jdbc_update 0.84s teardown test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.80s call test_postgresql_protocol/test.py::test_java_client 0.80s call test_jdbc_bridge/test.py::test_jdbc_insert 0.78s call test_placement_info/test.py::test_placement_info_missing_data 0.75s teardown test_postgresql_replica_database_engine_1/test.py::test_different_data_types 0.74s call test_placement_info/test.py::test_placement_info_from_config 0.70s call test_partition/test.py::test_cannot_attach_active_part 0.66s call test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed 0.66s setup test_partition/test.py::test_cannot_attach_active_part 0.65s call test_partition/test.py::test_partition_simple 0.65s call test_max_authentication_methods_per_user/test.py::test_create 0.58s call test_jdbc_bridge/test.py::test_jdbc_table_engine 0.55s call test_max_authentication_methods_per_user/test.py::test_create_default_setting 0.49s call test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 0.43s teardown test_partition/test.py::test_attach_check_all_parts 0.43s teardown test_partition/test.py::test_drop_detached_parts 0.42s call test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.41s call test_keeper_availability_zone/test.py::test_get_availability_zone 0.36s call test_keeper_memory_soft_limit/test.py::test_soft_limit_create 0.32s call test_jdbc_bridge/test.py::test_jdbc_query 0.27s call test_keeper_secure_client/test.py::test_connection 0.22s teardown test_partition/test.py::test_cannot_attach_active_part 0.22s teardown test_partition/test.py::test_partition_complex 0.22s call test_keeper_and_access_storage/test.py::test_create_replicated 0.22s teardown test_partition/test.py::test_partition_simple 0.22s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 0.10s call test_postgresql_protocol/test.py::test_python_client 0.01s teardown test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries 0.00s teardown test_interserver_dns_retires/test.py::test_query 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replicating_dml 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 0.00s setup test_placement_info/test.py::test_placement_info_from_imds 0.00s teardown test_keeper_profiler/test.py::test_profiler 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_single_transaction 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_1 0.00s teardown test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_different_data_types 0.00s teardown test_merge_tree_s3/test.py::test_table_manipulations[node] 0.00s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 0.00s setup test_max_authentication_methods_per_user/test.py::test_create 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables 0.00s teardown test_partition/test.py::test_make_clone_in_detached 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index 0.00s setup test_placement_info/test.py::test_placement_info_missing_data 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 0.00s setup test_max_authentication_methods_per_user/test.py::test_create_default_setting 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished 0.00s setup test_max_authentication_methods_per_user/test.py::test_alter_default_setting 0.00s setup test_jdbc_bridge/test.py::test_jdbc_update 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 0.00s setup test_jdbc_bridge/test.py::test_jdbc_query 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_quoting_2 0.00s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 0.00s setup test_partition/test.py::test_make_clone_in_detached 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 0.00s teardown test_placement_info/test.py::test_placement_info_from_imds 0.00s teardown test_max_authentication_methods_per_user/test.py::test_alter 0.00s setup test_interserver_dns_retires/test.py::test_query 0.00s setup test_jdbc_bridge/test.py::test_jdbc_insert 0.00s setup test_postgresql_protocol/test.py::test_python_client 0.00s teardown test_max_authentication_methods_per_user/test.py::test_create 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.00s setup test_placement_info/test.py::test_placement_info_from_file 0.00s setup test_partition/test.py::test_detached_part_dir_exists 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 0.00s teardown test_postgresql_protocol/test.py::test_psql_client 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 0.00s teardown test_merge_tree_s3/test.py::test_alter_table_columns[node] 0.00s setup test_postgresql_replica_database_engine_1/test.py::test_multiple_databases 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_insert 0.00s setup test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.00s teardown test_placement_info/test.py::test_placement_info_from_config 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_max_authentication_methods_per_user/test.py::test_alter_default_setting 0.00s teardown test_postgresql_protocol/test.py::test_java_client 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_delete 0.00s teardown test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 0.00s teardown test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] 0.00s teardown test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] 0.00s teardown test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 0.00s setup test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed 0.00s setup test_merge_tree_s3/test.py::test_attach_detach_partition[node] 0.00s teardown test_placement_info/test.py::test_placement_info_from_file 0.00s setup test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] 0.00s setup test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 0.00s teardown test_merge_tree_s3/test.py::test_attach_detach_partition[node] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 0.00s teardown test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] 0.00s teardown test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_table_engine 0.00s teardown test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 0.00s teardown test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] 0.00s teardown test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] 0.00s teardown test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] 0.00s teardown test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] 0.00s teardown test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] 0.00s setup test_postgresql_protocol/test.py::test_psql_client 0.00s teardown test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] 0.00s setup test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] 0.00s teardown test_merge_tree_s3/test.py::test_freeze_unfreeze[node] 0.00s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 0.00s setup test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 0.00s setup test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] 0.00s teardown test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] 0.00s setup test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] 0.00s setup test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] 0.00s setup test_merge_tree_s3/test.py::test_freeze_unfreeze[node] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] 0.00s setup test_jdbc_bridge/test.py::test_jdbc_table_engine 0.00s setup test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] 0.00s setup test_merge_tree_s3/test.py::test_table_manipulations[node] 0.00s setup test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] 0.00s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 0.00s setup test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] 0.00s setup test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] 0.00s setup test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] 0.00s setup test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] 0.00s setup test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 0.00s setup test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] 0.00s setup test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] 0.00s setup test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] 0.00s setup test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] 0.00s setup test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 0.00s setup test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 0.00s teardown test_partition/test.py::test_detached_part_dir_exists 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_query =========================== short test summary info ============================ ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] ERROR test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/.env', '--project-name', 'roottestmergetrees3withcache_gw6', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3_with_cache/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_merge_tree_s3/test.py::test_alter_table_columns[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_attach_detach_partition[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk] ERROR test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_freeze_unfreeze[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node] ERROR test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node] ERROR test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part] ERROR test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node] ERROR test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node] ERROR test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node] ERROR test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node] ERROR test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node] ERROR test_merge_tree_s3/test.py::test_s3_no_delete_objects[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_merge_tree_s3/test.py::test_table_manipulations[node] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/.env', '--project-name', 'roottestmergetrees3_gw0', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_0_gw0/node_with_limited_disk/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_keeper_profiler/test.py::test_profiler - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/.env', '--project-name', 'roottestkeeperprofiler_gw3', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_profiler/_instances_0_gw3/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... PASSED test_max_authentication_methods_per_user/test.py::test_alter PASSED test_max_authentication_methods_per_user/test.py::test_alter_default_setting PASSED test_placement_info/test.py::test_placement_info_from_config PASSED test_max_authentication_methods_per_user/test.py::test_create PASSED test_partition/test.py::test_attach_check_all_parts PASSED test_max_authentication_methods_per_user/test.py::test_create_default_setting PASSED test_partition/test.py::test_cannot_attach_active_part PASSED test_placement_info/test.py::test_placement_info_from_file PASSED test_placement_info/test.py::test_placement_info_from_imds PASSED test_partition/test.py::test_detached_part_dir_exists PASSED test_placement_info/test.py::test_placement_info_missing_data PASSED test_partition/test.py::test_drop_detached_parts PASSED test_jdbc_bridge/test.py::test_jdbc_delete PASSED test_jdbc_bridge/test.py::test_jdbc_distributed_query PASSED test_jdbc_bridge/test.py::test_jdbc_insert PASSED test_jdbc_bridge/test.py::test_jdbc_query PASSED test_jdbc_bridge/test.py::test_jdbc_table_engine PASSED test_jdbc_bridge/test.py::test_jdbc_update PASSED test_partition/test.py::test_make_clone_in_detached PASSED test_partition/test.py::test_partition_complex PASSED test_partition/test.py::test_partition_simple PASSED test_partition/test.py::test_system_detached_parts PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] PASSED test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication PASSED test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value PASSED test_postgresql_protocol/test.py::test_java_client PASSED test_postgresql_protocol/test.py::test_psql_client PASSED test_postgresql_protocol/test.py::test_python_client PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts PASSED test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted PASSED test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart PASSED test_keeper_availability_zone/test.py::test_get_availability_zone PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] PASSED test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions PASSED test_jbod_ha/test.py::test_jbod_ha PASSED test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 PASSED test_postgresql_replica_database_engine_1/test.py::test_different_data_types PASSED test_interserver_dns_retires/test.py::test_query PASSED test_keeper_memory_soft_limit/test.py::test_soft_limit_create PASSED test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables PASSED test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables PASSED test_keeper_and_access_storage/test.py::test_create_replicated PASSED test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries PASSED test_log_levels_update/test.py::test_log_levels_update PASSED test_postgresql_replica_database_engine_1/test.py::test_multiple_databases PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_1 PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader PASSED test_postgresql_replica_database_engine_1/test.py::test_quoting_2 PASSED test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index PASSED test_postgresql_replica_database_engine_1/test.py::test_replicating_dml PASSED test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished PASSED test_keeper_persistent_log_multinode/test.py::test_restart_multinode PASSED test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading PASSED test_postgresql_replica_database_engine_1/test.py::test_single_transaction PASSED test_keeper_secure_client/test.py::test_connection SKIPPED [1] test_merge_tree_load_parts/test.py:227: Skip with debug build and sanitizers. This test intentionally triggers LOGICAL_ERROR which leads to crash with those builds SKIPPED [1] test_library_bridge/test_exiled.py:53: Leak sanitizer falsely reports about a leak of 16 bytes in clickhouse-odbc-bridge ======= 69 passed, 2 skipped, 1 warning, 29 errors in 736.81s (0:12:16) ======== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_h9p2xq --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_interserver_dns_retires/test.py::test_query test_jbod_ha/test.py::test_jbod_ha test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_secure_client/test.py::test_connection test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_log_levels_update/test.py::test_log_levels_update test_max_authentication_methods_per_user/test.py::test_alter test_max_authentication_methods_per_user/test.py::test_alter_default_setting test_max_authentication_methods_per_user/test.py::test_create test_max_authentication_methods_per_user/test.py::test_create_default_setting test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 'test_merge_tree_s3/test.py::test_alter_table_columns[node]' 'test_merge_tree_s3/test.py::test_attach_detach_partition[node]' 'test_merge_tree_s3/test.py::test_cache_with_full_disk_space[node_with_limited_disk]' 'test_merge_tree_s3/test.py::test_freeze_system_unfreeze[node]' 'test_merge_tree_s3/test.py::test_freeze_unfreeze[node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[False-node]' 'test_merge_tree_s3/test.py::test_insert_same_partition_and_merge[True-node]' 'test_merge_tree_s3/test.py::test_lazy_seek_optimization_for_async_read[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_drop[node]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors[node-broken_s3_always_multi_part]' 'test_merge_tree_s3/test.py::test_merge_canceled_by_s3_errors_when_move[node]' 'test_merge_tree_s3/test.py::test_move_partition_to_another_disk[node]' 'test_merge_tree_s3/test.py::test_move_replace_partition_to_another_table[node]' 'test_merge_tree_s3/test.py::test_s3_disk_apply_new_settings[node]' 'test_merge_tree_s3/test.py::test_s3_disk_heavy_write_check_mem[node]' 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory0-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory1-node]' 'test_merge_tree_s3/test.py::test_s3_engine_heavy_write_check_mem[in_flight_memory2-node]' 'test_merge_tree_s3/test.py::test_s3_no_delete_objects[node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[0-16-node]' 'test_merge_tree_s3/test.py::test_simple_insert_select[8192-12-node]' 'test_merge_tree_s3/test.py::test_table_manipulations[node]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' test_parallel_replicas_snapshot_from_initiator/test.py::test_initiator_snapshot_is_used_for_reading test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_single_node test_peak_memory_usage/test.py::test_clickhouse_client_max_peak_memory_usage_distributed test_placement_info/test.py::test_placement_info_from_config test_placement_info/test.py::test_placement_info_from_file test_placement_info/test.py::test_placement_info_from_imds test_placement_info/test.py::test_placement_info_missing_data test_postgresql_protocol/test.py::test_java_client test_postgresql_protocol/test.py::test_psql_client test_postgresql_protocol/test.py::test_python_client test_postgresql_replica_database_engine_1/test.py::test_abrupt_connection_loss_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_abrupt_server_restart_while_heavy_replication test_postgresql_replica_database_engine_1/test.py::test_changing_replica_identity_value test_postgresql_replica_database_engine_1/test.py::test_clickhouse_restart test_postgresql_replica_database_engine_1/test.py::test_concurrent_transactions test_postgresql_replica_database_engine_1/test.py::test_different_data_types test_postgresql_replica_database_engine_1/test.py::test_drop_database_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_all_database_tables test_postgresql_replica_database_engine_1/test.py::test_load_and_sync_subset_of_database_tables test_postgresql_replica_database_engine_1/test.py::test_many_concurrent_queries test_postgresql_replica_database_engine_1/test.py::test_multiple_databases test_postgresql_replica_database_engine_1/test.py::test_quoting_1 test_postgresql_replica_database_engine_1/test.py::test_quoting_2 test_postgresql_replica_database_engine_1/test.py::test_replica_identity_index test_postgresql_replica_database_engine_1/test.py::test_replicating_dml test_postgresql_replica_database_engine_1/test.py::test_restart_server_while_replication_startup_not_finished test_postgresql_replica_database_engine_1/test.py::test_single_transaction -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.